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Abstract 

A distance-based inconsistency indicator, defined by the third author 
for the consistency-driven pairwise comparisons method, is extended 
to the incomplete case. The corresponding optimization problem is 
transformed into an equivalent linear programming problem. The re¬ 
sults can be applied in the process of filling in the matrix as the deci¬ 
sion maker gets automatic feedback. As soon as a serious error occurs 
among the matrix elements, even due to a misprint, a significant in¬ 
crease in the inconsistency index is reported. The high inconsistency 
may be alarmed not only at the end of the process of filling in the 
matrix but also during the completion process. Numerical examples 
are also provided. 

Keywords: linear programming, incomplete data, inconsistency analysis, 
pairwise comparisons. 


1 Introduction 

The use of pairwise comparisons (PC) is traced by some scholars to Ramon 
Llull (1232-1315). However, it is generally accepted that the modern use of 
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PC took place in [12] . It is a natural approach for processing subjectivity 
although objective data can be also processed this way. 

The consistency-driven approach incorporates the reasonable assumption 
that by hnding the most inconsistent assessments, one is able to reconsider 
his/her own opinions. This approach can be extended to incomplete data. 

Mathematically, an n x n real matrix A = [a^] is a pairwise comparison 
(PC) matrix if aij > 0 and = l/aji for all i,j = l,...,n. Elements 
ttij represent a result of (often subjectively) comparing the ith alternative 
(or stimuli) with the jth alternative according to a given criterion. A PC 
matrix A is consistent if a^ajk = atk for all i,j,k = 1,... ,?7,. It is easy to 
see that a PC matrix A is consistent if and only if there exists a positive 
n-vector w such that Ojj = Wi/wj, i, j = 1,..., n. For a consistent PC matrix 
A, the values Wi serve as priorities or implicit weights of the importance of 
alternatives. 

First, let us look at a simple example of a 3 x 3 reciprocal matrix: 

1 a b \ 

1/a 1 c j . (1) 

l/b Xjc 1 / 

Koczkodaj dehned the inconsistency index in [9] for ([1]) as 
CM{a, b, c) = min 

Duszak and Koczkodaj [3] extended this dehnition ([2D for a general n x n 
reciprocal matrix A as the maximum of CM{a,b,c) for all triads {a,b,c), 
i.e., 3x3 submatrices which are themselves PC matrices, in A: 

CM{A) = majc{CM{aij,aik,ajk) \ l<i<j<k< n}. (3) 

The concept of inconsistency index CM is due to the fact that the con¬ 
sistency of a PC matrix is dehned for (all) triads. By dehnition, a PC matrix 
is inconsistent if and only if it has as least one inconsistent triad. 

It is shown in [2] that CM and some other inconsistency indices are di¬ 
rectly related to each other but only in case of 3 x 3 PC matrices. As the 
size of PC matrix gets larger than 3x3, this function-like relation between 
diherent inconsistency indices does not hold. 
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Incomplete PC matrices were defined by Harker ilE]. Barker’s main 
jnstification of introdncing incomplete PC matrices is the possible claim for 
reducing the large number of comparisons in case of an e.g., 9x9 matrix 

([7],p.838.). 

In the incomplete PC matrix below, the missing elements are denoted by 
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• • • Oi^'^ 
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We assume that all the main diagonal elements are given and equal to 1. 
Incomplete matrices were analyzed in [D H EDI [n]. Most previous solutions 
are based on approaches for deriving weights from complete PC matrices. 
Weighting is not in the focus of the paper, however, incomplete PC matrices 
are also used in our approach. 

In our model, the use of incomplete PC matrix is rather means than ob¬ 
ject. The aim of the paper is to provide an LP based monitoring system which 
is able to compute CM-inconsistency in each step of the hlling in process as 
well as to inform the decision maker if s/he exceeds a given inconsistency 
threshold. The algorithm is constructive in the sense that it localizes the 
main root of CM-inconsistency. It is of fundamental importance to assume 
that the decision maker should be guided or supported but not led by making 
the comparisons for him/her in a mechanical way by proposing a reduction 
algorithm. 

Decision support tools for controlling or predicting inconsistency during 
the hlling in process have been provided by Wedley [13], Ishizaka and Lusti 
[8] and Temesi [T3] . 

As the decision maker hlls in a PC matrix, an incomplete PC matrix is 
resulted in by adding each element (except for the n{n — l)/2-th one, then 
the PC matrix becomes complete), whose CM-inconsistency, to be dehned, 
plays an important role in our inconsistency monitoring system. 

Let us assume that the number of the missing elements above the main 
diagonal in A is d, hence the total number of missing elements in A is 2d. 
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Let where ii < ji, denote the positions of the missing 

elements above the diagonal in A. 

Let us substitute variables / = 1,..., d, for the missing values above 
the main diagonal in A. Similarly, missing reciprocal values below the main 
diagonal are replaced by I = 1,... ,d. We denote the new matrix by 

... ,Xi^j^) to attack the following optimization problem: 

min CM{A{xi^j^,..., Xi^j^)) 

s.t. Xi^j^ > 0, / = 1,..., d, ^ 

for replacing the missing values by positives values and their reciprocals so 
that C'M(A(xjjj^,..., Xi^j^)) is minimal. It is easy to see the practical ramih- 
cations of this approach. There is no need to continue the hlling-in process of 
the missing elements if the optimal value of (jl]) exceeds a pre-determined in¬ 
consistency threshold. Instead, one should concentrate on hnding the sources 
of inconsistency among the already given elements in A. 

2 The LP form of the optimization problem 

The nonlinear structure of PC matrices is due to the reciprocal property 
{ttij = l/aji). However, when the element-wise logarithm of a PC matrix 
is taken, some properties, e.g. the transitivity rule {aijttjk = aik) becomes 
linear. Linearized forms also occur in weighting methods [5]. 

Let L = {{i,j) I 1 < * < j < n,aij is given} and L = {{ii,ji) \ I = 
1,..., d} denote the index sets of the given and missing elements, respectively, 
above the main diagonal in A. Then, for the sake of a unihed notation, 
introducing variables Xij for all {i,j) G L as well, and an auxiliary variable 
M, problem (j4]) can be written into the following equivalent form: 

min u 

s.t. CM{xij,Xik,Xjk) <u, l<i<j<k<n, , . 

Xij = aij, {i,j) e_L, 

Xij > 0, {i,j) e L. 

It is clear that ([5]) has a feasible solution, variable u is nonnegative for any 
feasible solution, the optimal values of dl]) and (|5]) coincide, furthermore, 
Xij > 0, (z, j) G L, is an optimal solution of (jl]) if and only if it is a part of 
an optimal solution of fISl) . 
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The problem (jS]) is not easy to solve directly because of the non-convexity 
of CM{-) of (j2]) in the arguments. However, a useful property of different 
inconsistency indicators for 3x3 PC matrices was published in [2]. For the 
3x3 PC matrix of ([T]), let us denote 

T{a,b,c) = . (6) 

0 ac I 


As shown in [2], 

CM{a, b, c) 


1 

T{a,b,c)' 


T{a,b, c) 


1 

l-CM{a,b,c)' 


(7) 


Since the univariate function f{u) = 1/(1 — m) is strictly increasing on 
(—oo, 1) and T(a, b, c) = f{CM{a, b, c)), problem ([5]) can be transcribed into 
the equivalent form 


min f{u) 

s.t. T{xij,Xik,Xjk) < f{u), 1 < i < j < k < n, 

Xij = aij, (ij) e_L, 

Xij > 0, {i,j) E L. 

By substitution t = f{u) and applying the dehnition ([6]), problem (JHl) can be 
written into the next equivalent form: 


min t 

s.t. XijXjk/xik <t, l<i<j<k<n, 

Xik! {xijXjk) <t, I <i < i <k <n, (9) 

Xij Ujj, {^1 i) £ L) 

Xij > 0, (hi) e L- 

Since t > 1 for any feasible solution of ([9]), the variables Xij are positive, and 
the function logf is strictly increasing over t > 0, we can use the old trick of 
the logarithmic mapping: 

^ = logt, 

Vij = log Xij, 1 <i < j <n, 
bij = logOij, {i,j) E L. 

Then ([9]) can be written into the following equivalent form: 
min z 

s.t. yij + yjk-yik<z, I <i < j < k < n, 

-Vij -yjk + yik<z, I <i < 3 <k < n, 
yij = bij, {i,j) E L. 


( 10 ) 


( 11 ) 
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The optimization problem fllip is a linear programming problem. It has a 
feasible solution with the non-negative objective function over the feasible 
region. Consequently, flTT]) has an optimal solution. Furthermore, problem 
dlj) has also an optimal solution because of the chain of equivalent problems 
established up to this point. The following statements summarize the essence 
of the equivalent transcriptions applied above. 

Proposition 1. Problems dl]) and (ITT]) have optimal solutions. 

If Xij > 0, {i,j) e L, is an optimal solution and u is the optimal value of 
dlj), then 

^ = log = -log(l -h), 

yij = log Xij, {i,j)eL, (12) 

yij = loga^, (ij) e L, 

is an optimal solution of flTT]) . 

Conversely, if z, yij,l < i < j < n, is an optimal solution of flTT]) . then 

Xij = eS*C {i,j) G L, (13) 

is an optimal solution and u = 1 — e~^ is the optimal value of (|1|). □ 

The most inconsistent triad, which is not necessarily unique, is identified 
from the active constraints in (ITTI) . If u is greater than a pre-dehned threshold 
of CM inconsistency, then the decision maker is recommended to reconsider 
the triad(s) associated with the active constraints. This case is involved in 
the third numerical example in Section 3. 

3 Numerical examples 

Three numerical examples are provided in this section. Let A be a 4 x 4 
incomplete PC matrix as follows: 

/I * 3.5 5 \ 

* 1 3 2.5 

1/3.5 1/3 1 * 

\ 1/5 1/2.5 * 1 

There are no complete triads in A. The optimization problem (jl|) can be 
written for this example as: 

min CM(A(a:i3,a;24)) 

s.t. a;i3,a;24>0. ^ 
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Reformulate (fT^ in the same way as fllip is derived from (jl]), the LP has a 
unique solution. Apply flT^ - (lT5]) . CM* = 0.236 is resulted in as the optimal 
value of flT^ and it is still less than the acceptable inconsistency threshold, 
assumed by Koczkodaj in [9] as CM <1/3. Consequently, acceptable incon¬ 
sistency can still be reached by a suitable £lling-in of the missing elements 
of A. 


Let B be a 5 X 5 incomplete PC matrix as follows: 


B 


/I * 1.5 2 * \ 

* 11/2*4 

1/1.5 2 1 * * 

1/2 * * 1 1/3 

\ * 1/4*31/ 


Now CM* = 0.62. The above example with incomplete data demon¬ 
strates there is no way of completing it with data to bring the inconsistency 
below 1/3 hence no need to even collect the missing data. This may be 
a helpful way of eliminating data collection which may be sometimes time 
consuming hence expensive. It is also noted that matrix B does not seem 
to be so bad at hrst sight. Let Ci, ^ 2 , Cs, C 4 , C 5 denote the criteria whose 
importancess are presented in B, and let Ci >- Cj denote that ’C* is more 
important than Cj\ One can check that the pairwise comparisons of B re¬ 
flect ordinally transitive relations: Ci >- C 3 >- C 2 >- C 5 >- C 4 ,. The roots of 
inconsistency are of cardinal nature rather than ordinal. 


Let D be a 7 X 7 incomplete PC matrix hlled in in a sequential order 
di 2 , di 3 ,..., d 23 , ^ 24 , • • • • Assume that the decision maker intends to write 
(i 45 = 4 but s/he happens to mistype it by ^45 = 1/4. The optimization 
problem flTT]) is solved after entering each matrix element and it contains 
2 X (g) = 70 inequality constraints and 1-16 (= number of known entries in 
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D ) equality constraints. 


/1 

3 

9 

3/2 

6 

5 

2 \ 

1/3 

1 

3 

1/2 

2 

3/2 

1/2 

1/9 

1/3 

1 

1/6 

2/3 

1/2 

1/5 

2/3 

2 

6 

1 

1/4 

* 

* 

1/6 

1/2 

3/2 

4 

1 

* 

* 

1/5 

2/3 

2 

* 

* 

1 

* 

Vl/2 

2 

5 

* 

* 

* 

1 / 



d\i 

(i-2,3, ...,7) 

^23 

<^24 

<^25 

^26 

^27 

dsi 

<^35 

dm 

dm 

<^45 

CM* 

0 

0 

0 

0 

1/10 

1/4 

1/4 

1/4 

1/4 

1/4 

15/16 (!) 


Although the CM threshold of acceptability for 7x7 matrices has not 
been defined yet, 1/3 is assumed to be applicable again. As CM* exceeds 
1/3 (significantly) when ^45 = 1/4 is entered, the inconsistency control iden¬ 
tifies it as a possible mistype and asks the decision maker for verification. If 
the decision maker finds ^45 = 1/4 appropriate and the most inconsistent 
triad in unique, then an error might occur before typing ^ 45 . In our example 
the most inconsistent triad in not unique, there are three of them, one is 
underlined above. However, all three triads contains ^ 45 . This fact suggests 
that the root of high inconsistency is in ^45 = 1 / 4 . 

The LP optimization problem flTTl) has been implemented in Maple 13 by 
using command LPSolve on a personal computer with 3.4 GHz processor and 
2 GB memory. GPU time, measured by command time() , remains under 
0.05 seconds as the size of matrices varies between 3x3 and 9x9 and the 
number of missing elements varies between 1 and 28. 


4 Conclusions and final remarks 

In this study, we have demonstrated that the distance-based inconsistency 
can be used to handle incomplete PG matrices as a natural extension of 
the complete case. It is shown that the determination of the minimal in¬ 
consistency level of the possible extensions of an incomplete PG matrix is 
equivalent to a linear programming problem. 



















In real life, gathering complete data may be difficult or time-consuming. 
Incomplete PC matrices occur in each step of the hlling in process even the 
PC matrix is completely given in the end. Thus the proposed approach is a 
useful tool for signalling the impossibility of completion the given incomplete 
matrix for an assumed inconsistency threshold as well as for improving the 
level of inconsistency. 
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